Pruning within Cascade-Correlation
نویسندگان
چکیده
Cascade-Correlation produces networks with all possible feed-forward connections. The pruning of redundant connections using a simple saliency measure is examined, along with three methods for stopping the pruning process which may be used with any network type. The methods are shown to be effective and it is further shown that a large number of redundant connections may be located and removed from Cascade-Correlation networks.
منابع مشابه
Dynamic Learning Algorithms
This is an investigation into various strategies for changing neural network architectures which examines both the theory of changing topologies and the current literature in the area. Experiments are performed on a combination of two of the more useful methodologies, Cascade-Correlation and connection pruning, which are able to produce more compact networks.
متن کاملA Comparative Study of Neural Network Optimization Techniques
In the last years we developed ENZO, an evolutionary neural network optimizer which surpasses other algorithms with regard to performance and scalability. In this study we compare ENZO to standard techniques for topology optimization: Optimal Brain Surgeon (OBS), Magnitude based Pruning (MbP), and to an improved algorithm deduced from OBS (unit-OBS). Furthermore we compare results to a newly pr...
متن کاملAn integrated growing-pruning method for feedforward network training
In order to facilitate complexity optimization in feedforward networks, several algorithms are developed that combine growing and pruning. First, a growing scheme is presented which iteratively adds new hidden units to full-trained networks. Then, a non-heuristic onepass pruning technique is presented, which utilizes orthogonal least squares. Based upon pruning, a one-pass approach is developed...
متن کاملMultiple-Instance Pruning For Learning Efficient Cascade Detectors
Cascade detectors have been shown to operate extremely rapidly, with high accuracy, and have important applications such as face detection. Driven by this success, cascade learning has been an area of active research in recent years. Nevertheless, there are still challenging technical problems during the training process of cascade detectors. In particular, determining the optimal target detect...
متن کاملInference by Learning: Speeding-up Graphical Model Optimization via a Coarse-to-Fine Cascade of Pruning Classifiers
We propose a general and versatile framework that significantly speeds-up graphical model optimization while maintaining an excellent solution accuracy. The proposed approach, refereed as Inference by Learning or in short as IbyL, relies on a multi-scale pruning scheme that progressively reduces the solution space by use of a coarse-to-fine cascade of learnt classifiers. We thoroughly experimen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995